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(54) IMAGE COMMUNICATION EQUIPMENT 

(57)Abstract 

PROBLEM TO BE SOLVED: To provide image 
communication equipment by which a face image is 
decorated by an image pattern for expressing a 
caricature image to emphasize feeling and an expression 
desired to be understood so as to make an opposite 
party rapidly grasp a transmitter's psychological situation 
when the transmitter transmits one's face image which 
is picked-up by an image pickup camera in a TV 
telephone set. 

SOLUTION: In image communication equipment in the 
TV telephone set, a subject image inputted to an image 
signal input part 1 10 is decorated by a deformation 
graphic which is stored in a deformation graphic 
information storage part 118. Then the subject image is 
deformed and transmitted to a communication opposite 
party. 



1 


?• 










*\ 


» 






•3- 










I 
r 




CO 




■I 

4 





LEGAL STATUS 

[Date of request for examination] 

[Date of sending the examiner's decision of 
rejection] 

[Kind of final disposal of application other than 
the examiner's decision of rejection or 
application converted registration] 

[Date of final disposal for application] 

[Patent number] 

[Date of registration] 

[Number of appeal against examiner's decision 
of rejection] 



[Date of requesting appeal against examiners 
decision of rejection] 

[Date of extinction of right] 



Copyright (C); 1998,2003 Japan Patent Office 



* NOTICES * 
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3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The image input section which picturizes the image of a photographic subject, and the 
distored geometry form information storage section holding the distored geometry form which 
embellishes to said photographic subject image inputted into said image input section, The 
deformation control unit which carries out the selection directions of the specific distored 
geometry form from said distored geometry form information storage section, The image 
effectiveness processing section which performs embellishing said photographic subject image 
according to said specific distored geometry form with directions of said deformation control 
unit Pictorial communication equipment characterized by having the communications control 
section which receives the photographic subject image embellished by the distored geometry 
form received from a communications partner at the same time it transmits said photographic 
subject image embellished by said image effectiveness processing section. 

[Claim 2] Pictorial communication equipment according to claim 1 characterized by the distored 
geometry form held in said distored geometry form information storage section being a still 
picture. 

[Claim 3] Pictorial communication equipment according to claim 1 characterized by the distored 
geometry form held in said distored geometry form information storage section being an 
animation. 

[Claim 4] The image input section which picturizes the image of a photographic subject, and the 
distored geometry form information storage section holding the distored geometry form which 
embellishes to said photographic subject image inputted into said image input section. The voice 
deformation control unit which performs deformation actuation with a sound signal to the 
distored geometry form held in said distored geometry form information storage section, The 
image effectiveness processing section which performs embellishing said photographic subject 
image according to the distored geometry form of said distored geometry form information 
storage section, Pictorial communication equipment characterized by having the communications 
control section which receives the photographic subject image embellished by the distored 
geometry form received from a communications partner at the same time it transmits said 
photographic subject image embellished by said image effectiveness processing section. 
[Claim 5] Pictorial communication equipment according to claim 4 characterized by the distored 
geometry form held in said distored geometry form information storage section being a still 
picture. 

[Claim 6] Pictorial communication equipment according to claim A characterized by the distored 
geometry form held in said distored geometry form information storage section being an 
animation. 

[Claim 7] Pictorial communication equipment given in either of claim 1 to claims 4 characterized 
by memorizing the graphic form created in the plot input section which has a handwriting input 
means in said distored geometry form information storage section. 

[Claim 8] Pictorial communication equipment given in either of claim 1 to claims 4 characterized 
by memorizing the pattern graphic form processed by the patternizing processing section which 
forms into a pattern graphic form the image of the photographic subject picturized by said image 
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input section in said distored geometry form information storage section. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] The image picturized with the camera in the TV phone is made to 
transform according to the voice condition of the image pattern expressing a transmitting 
person 's psychological situation, or a transmitting person, it transmits to a partner, and this 
invention relates to the pictorial communication equipment in a portable telephone with an image 
pick-up camera especially about the pictorial communication equipment as which an addressee 
can grasp a transmitting person's psychological situation quickly with the image which deformed 
[0002] 

[Description of the Prior Art] Conventionally, in a TV phone, if a transmitting person telephones 
to a partner, picturizing his face with the image pick-up camera, a transmitting person's face will 
copy him out on the display of the partners addressee's TV phone as an animation. Therefore, 
since it talked looking at a message partner's face from the audio usual telephone, it was thought 
that it was easy to grasp a motion of a partner's feeling. However, by the present animation, 
since an image consistency served as an animation like [ it is coarse and ] coma dropping, the 
expression with a fine face had the problem of being hard to be transmitted. There is JP.2000- 
151985,A as an image processing technique which changes the expression of a face by changing 
conventionally a persons face image photoed with the image pick-up camera at least for each 
part of the face image afterwards. 

[0003] By this proposal, it is going to change the configuration of a face image, magnitude, and a 

color so that it may make up by extracting at least each part of a face image 

[0004] 

[Problem(s) to be Solved by the Invention] However, the conventional image processing 
technique was not modification which is easy to catch the mental condition of the face image 
which emphasis was put by changing an original face image and was picturized in image by 
making up at least to each part of the picturized face image. 

[0005] On the other hand, it aims at offering the image communication device which can 
embellish a face image with the image pattern expressing a cartoon-image which amplifies the 
feeling which he wants to convey, and expression so that this invention is made in view of this 
point and I may have a partner grasp my psychological situation quickly, when a transmitting 
person transmits his own face image picturized with the image pick-up camera 
[0006] 

[Means for Solving the Problem] In order to solve this technical problem, the pictorial 
communication equipment of this invention The image input section which picturizes the image 
of a photographic subject, and the distored geometry form information storage section holding 
the distored geometry form which embellishes to said photographic subject image inputted into 
said image input section, The deformation control unit which carries out the selection directions 
of the specific distored geometry form from said distored geometry form information storage 
section, The image effectiveness processing section which performs embellishing said 
photographic subject image according to said specific distored geometry form with directions of 
said deformation control unit It is characterized by having the communications control section 



which receives the photographic subject image embellished by the distored geometry form 
received from a communications partner at the same time it transmits said photographic subject 
image embellished by said image effectiveness processing section. 

[0007] Its face image can be embellished with an image pattern which has its psychological 
situation quickly grasped with a specific deformation image. [ who transmits to the partner under 
message in a TV phone by this configuration ] 

[0008] Moreover, the pictorial communication equipment of this invention is characterized by the 
distored geometry form held in said distored geometry form information storage section being a 
still picture. 

[0009] By this configuration, by memorizing various still pictures variously as a deformation 
image in said distored geometry form information storage section, a suitable image can be 
chosen according to a situation and it can use as a deformation image. 

[0010] Moreover, the pictorial communication equipment of this invention is characterized by the 
distored geometry form held in said distored geometry form information storage section being an 
animation. 

[0011] By this configuration, since a motion can be given to the deformation image of said 
distored geometry form information storage section, an impression more strong against a 
communications partner can be given. 

[0012] Moreover, the image input section in which the pictorial communication equipment of this 
invention picturizes the image of a photographic subject. The distored geometry form information 
storage section holding the distored geometry form which embellishes to said photographic 
subject image inputted into said image input section. The voice deformation control unit which 
performs deformation actuation with a sound signal to the distored geometry form held in said 
distored geometry form information storage section, The image effectiveness processing section 
which performs embellishing said photographic subject image according to the distored geometry 
form of said distored geometry form information storage section. It is characterized by having 
the communications control section which receives the photographic subject image embellished 
by the distored geometry form received from a communications partner at the same time it 
transmits said photographic subject image embellished by said image effectiveness processing 
section. 

[0013] Since whenever [ distored geometry forms deformation ] is changeable with the message 
sound volume from a microphone, while a tone becomes strong by this configuration, the image 
of the face picturized with the camera can deform strongly, and can tell a rise of feeling visually 
to a communications partner. 

[0014] Moreover, the pictorial communication equipment of this invention is characterized by the 
distored geometry form held in said above-mentioned distored geometry form information 
storage section being a still picture. 

[001 5] By this configuration, when a distored geometry form is a still picture by the message 
sound volume from a microphone, whenever [ that deformation ] can be changed. 
[0016] Moreover, the pictorial communication equipment of this invention is characterized by the 
distored geometry form held in said above-mentioned distored geometry form information 
storage section being an animation. 

[0017] By this configuration, when a distored geometry form is an animation by the message 

sound volume from a microphone, whenever [ that deformation ] can be changed. 

[0018] Moreover, the pictorial communication equipment of this invention is characterized by 

memorizing the graphic form created in the plot input section which has the above-mentioned 

handwriting input means in said distored geometry form information storage section. 

[0019] By this configuration, it can register with the distored geometry form information storage 

section by making a free deformation pattern into a distored geometry form by inputting the 

graphic form of arbitration by the key stroke. 

[0020] Moreover, the pictorial communication equipment of this invention is characterized by 
memorizing the pattern graphic form processed by the patternizing processing section which 
forms into a pattern graphic form the image of the photographic subject picturized by the above- 
mentioned account image input section in said distored geometry form information storage 



section. 

[0021] By this configuration, since the graphic form of arbitration can be picturized and formed 
into a pattern graphic form with a camera, various graphic form patterns can be registered into 
abundance at the distored geometry form information storage section. 
[0022] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained to 
a detail with reference to a drawing. In addition, the case where the pictorial communication 
equipment in the gestalt of operation of this invention is realized in a TV phone here is explained 
as an example. 

[0023] (Gestalt of the 1 st operation) Drawing 1 is the configuration block Fig. of the image 
communication device in the gestalt of operation of the 1 st of this invention. In pictorial 
communication equipment 100, the central-process section 101 is the microcomputer equipped 
with CPU, ROM, RAM, etc., and controls each part described below through a signal / control 
bus 102. The input control unit 103 consists of function keys for the various function keys for a 
figure dialing key and a telephone function, the scrolling key of the display screen, and an image 
processing etc? The volume ihput~section 104 is for it being stepless and changing whenever 
[ image's deformation ] continuously in deformation processing of the image mentioned later. The 
sound signal input-and-output section 105 controls the voice input from a microphone 106, and 
the voice output to a loudspeaker 107 in a voice message. 

[0024] The liquid crystal display section 108 inputs the picture signal from a communications 
partner, and displays the image while it performs the number display in telephone actuation, and 
the actuation menu display of various functions. The image picturized by coincidence with the 
camera 109 is also displayed. 

[0025] The image codec circuit 1 1 1 decrypts the digital image signal which encoded the picture 
signal from a camera 109, and was encoded from picture compression / expanding circuit 112. 
[0026] While picture compression / expanding circuit 112 compresses the digital image signal 
encoded from the image codec circuit 111, it elongates the compression digital image signal from 
voice and image multiplex / decomposition section 1 1 3. The communications control section 1 1 6 
manages call connection control of a telephone, and the transmit/receive control of a sound 
signal and a picture signal by control of the central-process section 101. 

[0027] In addition to said each circuit section which operates said usual TV phone function, the 
image effectiveness processing section 1 1 7, the distored geometry form information storage 
section 118, and the motion information storage section 119 are arranged by the pictorial 
communication equipment 100 in the gestalt of operation of the 1st of this invention. 
[0028] The still picture graphic form which has various geometry is memorized as bit array 
information by the distored geometry form information storage section 118. On the other hand, 
the animation graphic form is memorized by the motion information storage section 1 1 9. If the 
image effectiveness processing section 117 has the command of the deformation image- 
processing initiation from the central-process section 101 The image which the camera 109 
picturized is inputted through the picture signal input section 1 10. Qualification with the still 
picture graphic form inputted to the image pick-up image, respectively from the distored 
geometry form information storage section 118 or the motion information storage section 119 or 
an animation graphic form is added, and it sends out to the image codec circuit 1 1 1, or is made 
to display on partial screen 108b of the liquid crystal display section 108 immediately. 
[0029] Next, actuation of the pictorial communication equipment in the gestalt of operation of 
the 1st of this invention is explained. Suppose that call connection is already established with 
the pictorial communication equipment (not especially shown) of a communications partner, and 
it is in a communication condition now. 

[0030] The actuation as pictorial communication equipment in the usual TV phone machine is 
stated to the beginning. 

[0031] It talks over the telephone with a microphone 106, making its face picturize with a camera 
109. 

[0032] The picture signal from a camera 1 09 is changed into a digital image signal from an analog 
picture signal by the picture signal input section 110, and is inputted and encoded by control of 



the central-process section 101 via a signal / control bus 102 in the image codec circuit 111. 
[0033] Next, it is compressed in picture compression / expanding circuit 112, and inputs into 
voice and image multiplex / decomposition section 1 1 3. 

[0034] On the other hand, the sound signal from a microphone 106 is changed into a digital 
sound signal in the sound signal input-and-output section 105, and is inputted and encoded by 
the voice codec circuit 114. Next, it is compressed in speech compression / expanding circuit 
115, and inputs into voice and image multiplex / decomposition section 113. Here, said digital 
sound signal and said digital image signal are multiplexed, and are transmitted to the pictorial 
communication equipment of a communications partner via a network 200 by control of the 
communications control section 1 1 6 as voice and an image multiplexed signal. 
[0035] On the other hand, the voice and the image multiplexed signal received by the 
communications control section 1 16 via the network 200 from the pictorial communication 
equipment of a communications partner are decomposed into a digital sound signal and a digital 
image signal in. voice and.imagejnultiplex / decomposition section 113. 

[0036] After being elongated in speech compression / expanding circuit 1 1 5, a digital sound 
signal is decrypted ih the voice codec circuit 114, is changed into an analog sound signal by the 
sound signal input-and-output section 105, and is outputted as voice from a loudspeaker. 
[0037] On the other hand, after being elongated in picture compression / expanding circuit 112, 
a digital image signal is decrypted in the image codec circuit 111, and is inputted into the liquid 
crystal display section 108 via a signal / control bus 102, and the image of a communications 
partner is displayed on main screen 108a. At this time, image display also of the picture signal of 
its face picturized with the camera 109 is carried out to coincidence via a signal / control bus 
102 at partial screen 108b of the liquid crystal display section 108. 

[0038] Drawing 2 is drawing showing the situation which has a TV phone machine in a talk state. 
Drawing 2 (a) is drawing showing the screen-display condition of its own TV phone machine A, 
and drawing 2 (b) is drawing showing the screen-display condition of the telephone B of a 
communications partner. 

[0039] As shown in drawing 2 (a), the image of a partner's face picturized with the camera 109 of 
the TV phone machine B of a communications partner is displayed on main screen 108a of the 
liquid crystal display section 108, and its own image picturized with the camera 109 of its own 
TV phone machine A is reduced and displayed on partial screen 108b. 

[0040] As shown in drawing 2 (b), the image of a partners face picturized with the camera 109 of 
the TV phone machine A of a communications partner is displayed on main screen 108a of the 
liquid crystal display section 108, and its own image picturized with the camera 109 of its own 
TV phone machine B is reduced and displayed on partial screen 108b. 

[0041] Next, the actuation at the time of performing the image effectiveness processing is 
explained. 

[0042] Drawing 3 is an explanatory view of processing in which the image of the face picturized 
with the camera 109 is embellished by the distored geometry form of a still picture. It is drawing 
in which being drawing showing the display image in the condition that drawing 3 (a) is drawing 
showing the display image of the profile pattern of a face image, and drawing 3 (b) made the 
square circumscribe to the profile pattern of a face image, and showing the display image of the 
face image which drawing 3 (c) is drawing showing the display image of the deformation profile 
pattern of the face image made to deform with a square, and drawing 3 (d) was made to 
transform with a square. 

[0043] Drawing 4 is drawing showing a situation in case the image of the face picturized with the 
camera is embellished by the distored geometry form of a still picture. Drawing 4 (a) is drawing 
showing the screen-display condition of its own TV phone machine A, and drawing 4 (b) is 
drawing showing the screen-display condition of the TV phone machine B of a communications 
partner. 

[0044] In the input control unit 103, if the initiation carbon button (not especially shown) 
concerning the image processing of an animation is set, the central-process section 101 will 
detect it and will order it image-processing initiation to the image effectiveness processing 
section 1 1 7. If the command of image-processing initiation is received, the image effectiveness 



processing section 117 will suspend a display in the liquid crystal display section 108 of the 
image under image pick-up until now, will incorporate the profile of the image of the face instead 
picturized with the camera 109 as bit array information, and will display it on the liquid crystal 
display section 104 as a profile pattern of a face image ( drawing 3 (a)). 

[0045] Coincidence is made to display the graphic form pattern of the still picture inputted from 
the distored geometry form information storage section 1 18 on a location other than the display 
position of the profile pattern of said face image. Although the still picture graphic form which 
has various geometry is memorized by the distored geometry form information storage section 
1 18, it can choose by operating the graphic form selection key (not especially shown) of the 
input control unit 103, making it display on the liquid crystal display section 104 one after 
another, and looking at 

[0046] For example, the case where a square is chosen is shown in drawing 3 (a). The mark of 
cross + is displayed on the center position by the selected square at coincidence. The graphic 
form chosen when this cross was moved by the arrow key « — >****) prepared in the input 
control unit 103 can be moved to a position. As shown in drawing 3 (b), this cross + is brought to 
the interior of the profile pattern of said face image. Since square magnitude can be changed at 
this time if rotation actuation of the volume input section 104 is carried out when said square is 
smaller than the magnitude of the profile pattern of said face image, if it is made for said square 
to be circumscribed to the profile pattern of said face image as rotation actuation is carried out 
suitably and it is shown in drawing 3 (c), four contacts (S1, S2, S3, S4) of the profile pattern of 
said face image and said square will be decided. You may carry out at this time, moving cross +, 
of course. 

[0047] If the X-axis and the Y-axis which make cross + of said square Zero O and which 
intersect perpendicularly are set up now, the bit array information on said square in this 
rectangular coordinate system and the bit array information on the profile pattern of said face 
image will be determined. 

[0048] Here, the vector R which makes Zero O the starting point is established. The locus of the 
tip point of the vector R in each direction when rotating this vector R counterclockwise forms 
the deformation profile pattern when transforming the profile pattern of said face image with said 
square. The deformation processing is performed as follows. 

[0049] When there is the direction of Vector R in the direction of the contact (S1, S2, S3, S4) of 
the profile pattern of said face image, and said square, the tip point of Vector R makes in 
agreement said contact (S1, S2, S3, S4). In the other direction, it extends outside the point that 
Vector R intersects the profile pattern of said face image. It is made to extend most especially 
when it is in the direction of four angles which form said square (0 ->t1, 0 ->t2, 0 ->t3, 0 ->t4). 
However, the point (t1, t2, t3. t4) of four angles is not extended. Although this is made to 
transform said face image with said square, it is because it is the deformation impressed as it is 
not made to deform into said square completely but was formal in said face image. If it does in 
this way, when one revolution of said vector R will be carried out to the surroundings of Zero O, 
the magnitude of Vector R In the direction of the angle of said square which exists while moving 
to the following contact from one contact of the profile pattern of said face image, and said 
square, it becomes max. It becomes small as it keeps away from there and the contact of said 
square is approached, and in said direction of a contact the tip point of Vector R is in 
agreement with the magnitude of the position vector of the profile pattern of said face image 
which passes along the contact 

[0050] Since the graphic form which extended the profile pattern of said face image in each 
direction is formed when Vector R rotates counterclockwise from said X-axis, the sequential 
storage of the bit array information on that deformation profile pattern is carried out as a 
deformation profile pattern H according this graphic form to said square of the profile pattern of 
said face image. Thus, when said vector R rotates one time around Zero O, the bit array 
information on the deformation profile pattern H of the face image by said square of the profile 
pattern of said face image is formed. As this deformation profile bit array information is sent to 
the liquid crystal display section 108 and shown in drawing 3 (c), the deformation profile pattern 
H of the face image by said square of the profile pattern of said face image is displayed. Here, if 



the volume input section 104 is clicked, the central-process section 101 will detect it and will 
order it the next image-processing initiation to the image effectiveness processing section 1 1 7. 
Next, the image effectiveness processing section 1 1 7 is expanded with the application of the 
ratio k (theta) which extends the magnitude of the vector R for every direction of Vector R so 
that said deformation profile pattern H may be suited in the face image part inside the profile 
pattern of said face image. Therefore, since the bit array information on the face image after 
deformation increases from the bit array information on the face image before deformation, bit 
array information is interpolated according to the ratio which extends the magnitude of the 
vector R for every direction of Vector R. 

[0051] Moreover, the color pixel information in each bit array information on said face image of 
the origin located in the direction of said vector R is also made to interpolate. As a result of this 
processing, as shown in drawing 3 (d), it changes to the face to which the profile of the image of 
the face picturized with the camera 109 was formal on the whole. 

[0052] In addition, although a. square is taken for an example as a distored geometry form and it 
was made for all the square sides to be circumscribed to the profile pattern of a face image in 
the explanation described above, the need does not not necessarily exist 

[0053] If the polygonal number of the sides increases, it will become difficult for the side to make 
all circumscribe to the profile pattern of a face image. Therefore, the following approaches may 
be taken in order not to circumscribe to the profile pattern of a face image. 
[0054] It is made to make the ratio k (theta) extended in the direction to which the polygonal 
intersection of two sides and polygonal Zero O are connected into max (namely, k-max), and it is 
the following, and the ratio k in other directions (theta) is made and defined. 

[0055] equal (referred to as k2) to the ratio k of the forward direction of a Y-axis (pi/2), and the 
ratio k of the negative direction (3pi/2) equally (referred to as k1) to ratio [ of the forward 
direction of the X-axis ] k (0), and the ratio k of the negative direction (pi) — it is made like. 
[0056] Next, between the direction to which the polygonal intersection of two sides and 
polygonal Zero O are connected, the forward direction of the X-axis, or the negative direction, a 
ratio is set up so that it may change from k-max to k1, and between the directions which 
connect the forward direction of a Y-axis or the negative direction, the polygonal intersection of 
two sides, and Zero O, a ratio is set up so that it may change from k-max to k2. Moreover, when 
the line of the direction to which the polygonal intersection of two sides and polygonal Zero O 
are connected adjoins each other, it is made to make the ratio of the middle direction smaller 
than k-max, and it sets up so that it may bring close to k-max, as it approaches in the direction 
to which the polygonal intersection of two sides and polygonal Zero O are connected. When it 
does in this way, it becomes unnecessary to circumscribe the polygon which is a distored 
geometry form to the profile pattern of a face image. 

[0057] Next, when the graphic form chosen from the distored geometry form information storage 
section 118 is a circle The profile of the face image picturized with the camera 109 is not made 
into a perfect circle. The vector R on the basis of the zero O which set up the circle 
circumscribed to the profile of a face image, and was prepared in the circle in the direction of 
the point of contacting the profile of said face image, and a circumscribed circle It sets without 
holding the bit array information on a subject copy and elongating the profile of said face image, 
and in the other direction, as predetermined expanding is added, the magnitude of Vector R is 
changed. If Vector R goes around the surroundings of Zero O, the locus of the tip point of 
Vector R will form as a result the deformation profile pattern of the face image for which the 
profile of a face image was deformed by the circle. If the bit array information on a deformation 
profile pattern is sent to the liquid crystal display section 104, the profile of an image roundish 
[ wore on the whole ] will be displayed. Hereafter, the art of the bit array information on the part 
in the profile of a face image is performed like the case of deformation by the square. 
[0058] In addition, the ratio k showing extent of expanding in each direction when changing the 
profile pattern of the face image by this distored geometry form (theta) is beforehand decided at 
the time of the design of the screen display of the liquid crystal display section 104 for every 
graphic form memorized by the distored geometry form information storage section, and is held 
in the image effectiveness processing section 117 as a table. Moreover, since the magnitude can 



be freely set up when not making a distored geometry form circumscribe to the profile pattern of 
a face image, the include-angle dependence of a ratio k (theta) can be changed with the 
magnitude of a distored geometry form. 

[0059] As mentioned above, the image of the face which was deformed by the distored geometry 
form of the distored geometry form information storage section 118, and was picturized with the 
camera 109 Encode in the image codec circuit 111 and it is compressed in picture 
compression / expanding circuit 1 12. In picture compression / expanding circuit 112, it 
multiplexes with a sound signal, and is sent out from the communications control section 1 1 6 in 
a network 200, and the image embellished by the distored geometry form is displayed on main 
screen 108a of the liquid crystal display section 108 of the TV phone machine B of a partner 
communications partner. 

[0060] Therefore, as shown in drawing 4 (a), the image of a partner's face picturized with the 
camera 109 of the TV phone machine B of a communications partner is displayed, it is picturized 
by partial screen 108b with the camera 109 of its own TV phone machine A, and its own image 
embellished by the distored geometry form is reduced and displayed on main screen 108a of the 
liquid crystal display section 108 of the TV phone machine A. 

[0061] On the other hand, as shown in drawing 4 (b), the image of a partner's face which was 
picturized by main screen 108a of the liquid crystal display section 108 of the TV phone machine 
B with the camera 109 of the TV phone machine A of a communications partner, and was 
embellished by the distored geometry form is displayed, and its own image picturized with the 
camera 109 of its own TV phone machine B is reduced and displayed on partial screen 108b. 
[0062] Next, the case where the image of the face picturized by the animation with the camera 
109 as the 2nd example is embellished is explained. 

[0063] Drawing 5 is an explanatory view of processing in which the image of the face picturized 
with the camera is embellished by the distored geometry form of an animation. Drawing 5 (a) is 
drawing showing a situation in case it is drawing showing a square animation condition, and 
drawing 5 (b) is drawing showing the condition that the square circumscribed the face image 
before the animation condition, the square of drawing 5 (c) is drawing showing the condition of 
having made the face image transforming with a square before an animation condition and 
drawing 5 (d) has a square in an animation condition. 

[0064] In the input control unit 103, if the initiation carbon button (not especially shown) 
concerning the image processing of an animation is set, the central-process section 101 will 
detect it and will order it image-processing initiation to the image effectiveness processing 
section 1 1 7. If the command of image-processing initiation is received, the image effectiveness 
processing section 117 will suspend the image display to the liquid crystal display section 108 till 
then, will incorporate the profile of the image of the face instead picturized with the camera 109 
as bit array information, and will display it on the liquid crystal display section 108 as a profile 
pattern of a face image. The animation graphic form pattern which moved to the location other 
than the display position of the profile pattern of said face image, and was inputted into 
coincidence from the information storage section 119 is displayed. 
[0065] Although various animation graphic form patterns are memorized by the motion 
information storage section 119, it can choose making it display on the liquid crystal display 
section 104 one after another, and looking at by operating the animation selection key (not 
especially shown) of the input control unit 103. 

[0066] said animation graphic form pattern — the visible outline of graphic forms, such as a 
polygon or a circle, and an ellipse, — the fixed direction — parallel — the fixed amplitude — 
continuous — a sine — functional fluctuation is performed. 

[0067] For example, the case of a square is shown in drawing 5 (a), if the X-axis and the Y-axis 
which intersect perpendicularly in the zero O shown by cross + in said square are set up — the 
square of drawing 5 (a) — X shaft orientations — parallel — the fixed amplitude — continuous - 
- a sine — functional fluctuation is performed, consequently, the side of the length of right and 
left of said square — a sine — functional fluctuation is carried out. If this cross is moved by the 
arrow key « — >****) prepared in the input control unit 103, the selected animation (square with 
which the side of length on either side is changed in parallel with the X-axis in this case) can be 



moved to a position. As shown in drawing 5 (b), this cross + is brought to the interior of the 
profile pattern of said said face image. Since square magnitude can be changed at this time if 
rotation actuation of the volume input section 104 is carried out when a square is smaller than 
the magnitude of the profile pattern of said face image, it is made for said square to be 
circumscribed to the profile pattern of said face image, as rotation actuation is carried out 
suitably and it is shown in drawing 5 (b). Here, if the volume input section 104 is clicked, the 
central-process section 101 will detect it and will order it the next image-processing initiation to 
the image effectiveness processing section 117. consequently, said face image with which said 
face image circumscribed by said square deformed as said square showed to drawing 5 (c) in 
response to deformation processing, and it received the deformation processing further — X 
shaft orientations — parallel — the fixed amplitude — continuous — a sine — functional 
fluctuation will be performed. If the bit array information on said face image which received 
deformation with said square is sent to the liquid crystal display section 108, the profile of the 
image of the face picturized_with the camera 109 will change to the squarish face on the whole, 
and will be displayed to swing right and left on the whole moreover on the display screen. 
[0068] (Gestalt of the 2nd operation) Drawing 6 is the configuration block Fig. of the image 
communication device in the gestalt of operation of the 2nd of this invention. In drawing 6 , the 
volume input section 104 in the gestalt of the 1st operation is lost, and the sound signal 
transducer 120 is newly formed. The sound signal from a microphone 106 is inputted into the 
sound signal transducer 120 at the same time it is changed into a digital sound signal in the 
sound signal input-and-output section 105 and is outputted to the voice codec circuit 114. The 
sound signal transducer 120 detects the signal level of the inputted digital sound signal, and 
generates the loudness-level-of^sound identification code signal which divides the level of sound 
volume into several steps. This loudnessHevel-of^sound identification code signal is inputted 
into the central-process section 101. A still picture graphic form is chosen from the distored 
geometry form information storage section 118, and next, the image which embellished the image 
of the face picturized with the camera 109 is generated, and it is made to display on the liquid 
crystal display section 108 with the still picture by operating the predetermined key of the input 
control unit 103. The central-process section 101 makes a display on the partial screen of the 
liquid crystal display section 108 start the image which embellished the image of the picturized 
face with the still picture, when the loudness-level-of^sound identification code signal from the 
sound signal transducer 120 is larger than predetermined level. If a message person enlarges 
voice or makes it small, the loudness-level-of^sound identification code signal from the sound 
signal transducer 120 will change, and the magnitude of a message person's face displayed on 
partial screen 108b of the liquid crystal display section 108 will change according to it The image 
of a message persons face embellished with the still picture which changes with the level of the 
aforementioned loudness-level-of^sound identification code signal is displayed on main screen 
108a of the liquid crystal display section 108 of the mobile videophone machine B of a 
communications partner. When the animation selection key (not especially shown) of the input 
control unit 103 is operated, the magnitude of the image embellished with the animation changes 
according to the magnitude of voice. 

[0069] (Gestalt of the 3rd operation) Drawing 7 is the configuration block Fig. of the image 
communication device in the gestalt of operation of the 3rd of this invention. As shown in 
drawing 7 , the plot input section 121 connects with the picture signal input section. 
[0070] The plot input sections 121 are a pen input, a mouse, a trackball, etc., and if these are 
operated and the graphic form of arbitration is drawn, the locus will be displayed on the display 
screen of the liquid crystal display section 108. Then, if definite actuation is performed, the bit 
array information on said graphic form will be memorized by the distored geometry form 
information storage section 1 1 8 as a distored geometry form. 

[0071] Moreover, in the input control unit 103, if the initiation carbon button (not especially 
shown) concerning the image processing of an animation is set, the central-process section 101 
will detect it and will order it image-processing initiation to the image effectiveness processing 
section 117. Consequently, it image-encodes, is picture-compression-ized, multiplexes with the 
sound signal from a microphone 106, and is transmitted to the pictorial communication 



equipment of a communications partner via a network 200 by control of the communications 
control section 1 16 as voice and an image multiplexed signal at the same time the image of the 
face which the camera 109 picturized is embellished and it is displayed on the display screen of 
the liquid crystal display section 108 with the graphic form of arbitration inputted from the plot 
input section 121. 

[0072] (Gestalt of the 4th operation) Drawing 8 is the configuration block Fig. of the image 
communication device in the gestalt of operation of the 4th of this invention. As shown in 
drawin * 8 • the Patternizing processing section 122 is newly connected to the picture signal input 
section 1 10 and the distored geometry form information processing section 1 18. The picture 
signal of the image picturized with the camera 109 is inputted into the picture signal input 
section 110, is changed into a digital image signal and inputted into the patternizing processing 
section 122. With the pen input of the plot input section 121. a mouse, and a trackball since it is 
displayed on coincidence by the liquid crystal display section 108, if some images of the liquid 
cry stal display section 108 are marked, the patternizing processing section 122 will take out said 
marked part as a form of a visible outline out of the inputted picture signal, and will memorize it 
in the distored geometry form information processing section 1 18 by making it into the graphic 
form pattern for image deformation. This visible outline is used in the image effectiveness 
processing section 1 17 in deformation processing of the face image picturized with the camera 
109 as a distored geometry form, as the gestalt of the 1st operation was described. Thus a 
distored geometry form can newly in addition to a finite graphic form be created, and it can use 
now for deformation processing of a face image. 
[0073] 

[Effect of the Invention] As explained above, the image communication device by this invention 
can be embellished with an image pattern which has its psychological situation quickly grasped 
with various deformation images which memorized their face image in the distored geometry 
form storage section. [ who transmits to the partner under message in a TV phone ] 
[0074] Moreover, by memorizing various still pictures or an animation variously as a deformation 
image in said distored geometry form storage section, a suitable image can be chosen according 
to a situation and it can use as a deformation image. 

[0075] Moreover, in order to register a deformation image into said distored geometry form 
storage section, a distored geometry form can be created simple by inputting a handwritten 
graphic form by the plot input section, or carrying out patternizing processing and inputting the 
graphic form picturized with the camera. 
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